arXiv:1501.00161vl [math.DS] 31 Dec 2014 


Distance function design and Lyapunov techniques for the 
stability of hybrid trajectories * * * § 

J. J. Benjamin Biemondj W. P. Maurice H. Heemelsf 
Ricardo G. SanfeliceLnd Nathan van de Wouw ^ 

5th January 2015 


Abstract 

The comparison between time-varying hybrid trajectories is crucial for tracking, observer 
design and synchronisation problems for hybrid systems with state-triggered jumps. In this 
paper, a systematic way of designing an appropriate distance function is proposed that can 
be used for this purpose. The so-called “peaking phenomenon”, which occurs when using the 
Euclidean distance to compare two hybrid trajectories, is circumvented by taking the hybrid 
nature of the system explicitly into account in the design of the distance function. Based 
on the proposed distance function, we define the stability of a trajectory of a hybrid system 
with state-triggered jumps and present sufficient Lyapunov-type conditions for stability of 
a hybrid trajectory. A constructive design method for the distance function is presented 
for hybrid systems with affine flow and jump maps and a jump set that is a hyperplane. 
For this case, the mentioned Lyapunov-type stability conditions can be verified using linear 
matrix conditions. Finally, for this class of systems, we present a tracking controller that 
asymptotically stabilises a given hybrid reference trajectory, and we illustrate our results 
with examples. 

Keywords: Hybrid systems; stability analysis; Lyapunov stability; tracking control 


1 Introduction 


Hybrid system models have proven valuable to capture the dynamics of complex systems arising 
in the domains of mechanical, chemical or electrical engineering, as well as in biological and 
economical systems, as these models combine continuous-time dynamics with discrete events or 
While the stability of isolated points or closed sets of hybrid systems is 
the stability of time-varying trajectories of these systems 


jumps 


11 13 21 31 


relatively well-understood 111 131121 31 


received significantly less attention and many issues are presently unsolved. Given the importance 
of stability of trajectories in tracking control, observer design and synchronisation problems, it is 
important to address these open issues. 

Background: One of the main complications to study the stability of hybrid trajectories is the 
“peaking phenomenon” of the Euclidean distance between two trajectories, that can be observed 
when jump times do not coincide, and the states of two hybrid trajectories are compared at the 
same continuous-time instant, as observed in 17 23 in the framework of measure differential in¬ 


clusions, in 12 for complementarity systems, and in (3 28 for jump-flow systems. “Peaking” of 
the Euclidean error occurs when two solutions from close initial conditions do not jump at the 
same time instant. When, before the first jump, the Euclidean error is small, then the Euclidean 
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error approximately equals the jump distance directly after the first jump. A jump of the other 
solution may again render the Euclidean distance small. As the amplitude of the resulting peak 
in the Euclidean error cannot be reduced to zero by taking closer initial conditions, trajectories of 
hybrid systems with state-triggered jumps are generically not asymptotically stable with respect 
to the Euclidean measure. The latter is even the case when the jump times of both trajectories 
converge to each other and, consequently, the large Euclidean error occurs only during smaller and 
smaller time intervals near the jumps, after which periods of flow follow in which both trajectories 
are close. As this scenario corresponds to desirable behaviour and therefore should correspond to 
small errors, it is clear that the Euclidean error is not a good measure in this context. 

Only under more severe system assumptions, the standard stability analysis based on the Euc¬ 
lidean error can be employed. Indeed, when jumps of two trajectories are synchronised, then the 
standard approach can be employed where the difference between both trajectories is required 
to behave asymptotically stable along trajectories, leading, for example, to successful tracking 
control approaches presented in [ 18||28 . However, in this paper, we focus our attention to systems 
with state-triggered jumps, for which, generically, jumps of neighbouring trajectories are not syn¬ 
chronised, such that the “peaking behaviour” typically occurs and the comparison of trajectories 
becomes much more challenging. 

The “peaking” of the Euclidean error occurs when two states of the system are compared at a 
given time. Alternatively, the graphs of complete trajectories can be compared. This approach 
allows to study dynamical characteristics including the continuity of trajectories with respect to 
initial conditions, as presented in [5,11 24]. However, using such a trajectory-based measure, it 
is hard to formulate constructive conditions (e.g. Lyapunov-based) to guarantee the stability of 
hybrid trajectories. Therefore, the study of the stability of trajectories in this paper is performed 
by considering the evolution of a suitably defined distance along the trajectories, therewith neces¬ 
sitating the formulation of a distance function between states of the system. 

Focussing on mechanical systems with unilateral position constraints, that include billiard systems, 
two approaches have been presented in the literature to avoid the “peaking behaviour”. Firstly, 
focussing on impacts with non-zero restitution coefficients, it has been observed that during the 
peaks of the Euclidean error, the two trajectories are far apart, but one trajectory is close to the 
image of the other that is mirrored in the constraint surface. The Zhuravlev-Ivanov method, cf. [4], 
describes the trajectory of the real system together with the mirrored images. In this manner, 
trajectories can cross the constraint by switching from the real to the mirrored state. Hence, the 
dynamics can be described with a (discontinuous) differential equation without impacts, therewith 
avoiding the peaking phenomenon. In tracking control and observer problems are defined 

by requiring the asymptotic stability of a set that consists of the real system and the mirrored 
images. As a second approach, in [9,d0[[23[[25], the standard Euclidean state error is employed 
away from the impacts times, while near impacts, only the position error, and no velocity error is 
considered. 

In [3], the comparison of trajectories with non-synchronised jumps is facilitated by a distance 
function that takes the jumping nature of the hybrid system into account, therewith avoiding 
the “peaking phenomenon”. In [3], we presented sufficient conditions on this distance function, 
such that stability in this distance function corresponds to an intuitively correct stability notion 
in the sense that the time mismatch between jumps of trajectories with close initial conditions 
remains small, and away from the jump times, their states are close. However, no constructive 
design for this distance function was presented. Only for two examples, such a distance function 
was proposed in 3i . Focussing on a class of constrained mechanical systems, a similar distance 
function was employed in 32 to study continuity of trajectories with respect to initial conditions. 
Both in [ 3 ] and ii 


! , ad-hoc techniques were used to design the distance function. 
Contributions: As a first main contribution in the current paper, we present a constructive and 
general design for the distance function. In order to evaluate this distance function along two 
different hybrid trajectories, an extended hybrid system is employed, of which each trajectory rep¬ 
resents the two original trajectories. This construction results in a combined hybrid time domain, 
and is feasible if both trajectories have a hybrid time domain that is unbounded in the continuous¬ 
time direction. We show that when the (global) asymptotic stability is defined with respect to 


2 







the new distance function, then the proposed distance function provides an intuitively correct 
comparison between two hybrid trajectories. As a second main contribution, sufficient conditions 
for asymptotic stability are presented that rely on Lyapunov functions that may increase during 
either flow or jump, as long as the Lyapunov function eventually decreases along solutions. For 
this purpose, maximal or minimal average dwell-time arguments are employed, as proposed in the 
context of impulsive systems in 14 . The third main contribution consists of the application of 


the developed stability theory to tracking control problems for a class of hybrid systems where the 
jump map is an affine function of the state, the jump set is a hyperplane, and the continuous-time 
dynamics can be influenced by a bounded control input. This class of systems contains certain 
models of mechanical systems with unilateral constraints. A piecewise affine tracking control law 
is designed that achieves asymptotic tracking in the proposed distance measure. This property 
is proven using a piecewise quadratic Lyapunov function with disconnected sub-level sets, such 
that the asymptotic stability with respect to the new distance notion can be analysed with com¬ 
putationally tractable matrix relations. Finally, the results of this paper are illustrated with two 
examples. 

Outline: This paper is outlined as follows. First, we present the class of hybrid systems considered 
in Section [2] and design the distance function in Section [3] Subsequently, the extended hybrid sys¬ 
tem is proposed and the stability of trajectories is defined in Section [4] A Lyapunov theorem to 
study the stability of a hybrid trajectory is presented in Section [5j and a constructive piecewise 
quadratic Lyapunov function is designed in Section [6] for a class of hybrid systems with affine 
jump maps and the jump set contained in a hyperplane. These results are applied to tracking 
control problems in Section [7] Finally, two illustrative examples are given in Section [8j followed 
by conclusions in Section [9] 

Notation: Let N and N >0 denote the set of nonnegative and positive integers, respectively. 
For a set X C R”, dX denotes its boundary and for each y £ K", the distance between y 
and X is dist(y, X) := inf xe x ||x — y ||. The set B C R" is the closed unit ball. Given a 
(possibly set-valued) map F with domain of definition dom F C R n and a set S C dom F, 
F(S ) = {y\y £ F(x), with £ £ S'} denotes its image; F(y) = 0 for y £ dom F, F k (x), with 
x £ dom F, k £ N >0 , denotes F(F k ~ 1 (x)) and for all x £ R", F°(x) = { 2 }. Let F~ 1 (S) denotes 
its pre-image, namely, F~ 1 (S) = {x : F(x) D S 7 ^ 0}. A set-valued map F : S C R" =$ R n is outer 
semicontinuous if its graph {(i,j/)£l"xl": x £ S,y £ F(x)} is closed, and locally bounded 


if, for each compact set S C S, F(S) is bounded. Using Definition 1.4.11 in [2], an outer semicon¬ 
tinuous mapping F : S =4 Y is proper if for every sequence {(x n , y n )}neN where y n £ F(x n ) and 
y n converges in Y. the sequence {injngM has a cluster point x. i.e., there is a point (x, y) £ S x Y 
and a subsequence of {x n , 2/ n }neN that converges to ( x,y ). We note that F is proper only if it is 
outer semicontinuous. For n : m £ N>o, let I n and O mn denote the identity matrix and the matrix 
of zeros of dimension nx n and m x n, respectively. Given matrices A, B £ R raxn , A -< 0 and 
A A 0 denote that A is symmetric and negative define or negative semidefinite, respectively. We 
write A Y B and A -< B when A — B < 0 and A — B -< 0, respectively. Similarly, A Y B denotes 
B -< A and AY B denotes B -< A. 


2 Hybrid system model 

Consider the hybrid system 


x £ F(t, x) x £ C, (la) 

x + £ G{x) x £ D, (lb) 

with F : [0, 00 ) xCd R" and G : D =4 R n , where C C R" and D C R n . We emphasize that the 
jump map G is independent of the time t. which, in the following, will be exploited in the design of 
the distance function. In contrast to embedding an extra variable with dynamics t = 1, we prefer 
to use explicit time-dependency of the flow map F, as this allows to study the perturbation of 
initial conditions without perturbing the initial time. The class of hybrid systems in the form ([T]) 
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Figure 1: a),b) Projection on the f-axis of trajectories x and Xd obtained for the hybrid system 
with data ([2]). c) Euclidean distance function. 


is quite general and permits modelling systems arising in many relevant applications, including 
mechanical systems with impacts 


11 and event-triggered control systems, see e.g. 26 


To illustrate the “peaking behaviour” mentioned in Section [lj in Fig. [TJ a reference trajectory Xd 
and a trajectory x of a hybrid system are shown. The data of this hybrid system is 


C = [0, oo) xl, D = {0} x (—oo,0], 
F(t, x) = (x 2 ~g + u(t)) T , G(x) =—a 


( 2 ) 


with g = 9.81, such that this systems models the dynamics of a bouncing ball where finite forces 
can be applied. The reference trajectory Xd is generated by the hybrid system with input u = 0, 
initial condition Xdo = (0 10) and initial time to = 0, while the input u , that generates the 

trajectory x from initial condition xo = (0 3) T and initial time to = 0, enforces convergence of x 

to Xd in the sense that the graphs of both trajectories converge to each other. (In fact, the tracking 
control law we propose in Sectionals applied.) Indeed, the error between the jump times of both 
trajectories approaches zero over time, and, in addition, away from the jump times the states of 
both systems approach each other. However, the Euclidean distance between the trajectories does 
not converge to zero. This “peaking phenomenon” renders the Euclidean distance not appropriate 
to compare these hybrid trajectories, thereby motivating this study towards systematic techniques 
to find proper distance functions that do converge to zero in situations as in Fig. [T] 

We will propose such distance functions for systems ([!]) that satisfy the “hybrid basic conditions” 
as defined for autonomous systems in 
pend on t. While the conditions in 


11 


11 , adapted to allow functions F(t,x) in (fLaJ which de- 


are used to ensure robustness and invariance properties, 
in this paper, the conditions in Assumption |T] below are used both to employ Krasovskii-type 
solutions during flow, and to enable a comparison between trajectories, as will become more clear 
in Theorem [l] below. 
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Assumption 1. The data of the hybrid system satisfies 

• C,D are closed subsets of R n with C U D / 0; 

• the set-valued mapping F(t,x) is non-empty for all (t,x) £ [to,oo) x C, measurable, and for 
each bounded closed set S C [fo,oo) x C, there exists an almost everywhere finite function 
m(t ) such that ||/|| < m(t) holds for all f £ F(t,x) and for almost all ( t,x ) £ S; 


• G : D =4 R™ is nonempty, outer semicontinuous and locally bounded. 

We consider solutions p to (fll) defined on a hybrid time domain dom p C [to, oo) x N as follows, 

0 *—^ j 

. We call a subset E of [to, oo) xN a compact hybrid time domain if E = Uj=o (fe> tj+i ] x {j}) 
tor some finite sequence to < ti < t 2 < ... < tj. The set £ is a hybrid time domain if for all 
T, J £ E, ED([t 0 , T] x {0,1,..., J}) is a compact hybrid time domain. Given a hybrid time domain 
dom ip, a hybrid time instant is given as (t, j) £ dom <p, where t denotes the ordinary time elapsed 
and j denotes the number of experienced jumps. The function ip : dom p —> M n is a solution of 
([I]) when jumps satisfy (lbI and, for fixed j £ N, the function t —> p(t,j) is locally absolutely 
continuous in t and a solution to ( |Ta| ). This means p(t,j) £ D and <p(t,j + 1) £ G(p(t,j)) 
for all (t,j) £ dom <p such that ( t,j + 1) £ dom p and p(t,j) £ C, -^p(t,j) £ F(t,p(t,j )) for 
almost all t £ Ij := {t| (t, j) £ dom pj and all j such that Ij has nonempty interior. Herein, 
F(t, x) = a> 0 co{F(t, (x + <5B) n C)} represents the Krasovskii-type convexification of the vector 
field which is restricted to C, cf. [30 , where co denotes the closed convex hull operation. The 
solution p is said to be complete if dom ip is unbounded. The hybrid time domain dom p is called 
unbounded in t-direction when for each T > 0 there exist a j such that ( T,j ) £ dom p. In this 
paper, we only consider maximal solutions, i.e., solutions p such that there are no solutions (p to 
0 with p(t,j) = p(t,j) for all (t,j) £ dom p, and dom p a hybrid time domain that strictly 
contains dom p. 


3 Distance function design 


We will now present a distance function that does not experience the “peaking behaviour” that can 
occur in the Euclidean distance between two trajectories of ([I]), as described in the introduction 
and illustrated in Fig. [I];). We do so for hybrid systems that satisfy the following assumption. 

Assumption 2. The data of the hybrid system ([l]) is such that G is a proper function, there is a 
k > 0 for which G k (D ) n D = 0 and every maximal solution of |l]) has a hybrid time domain that 
is unbounded in t-direction. 


We exploit this property in order to define a distance function for the system ([I]). 

Remark 1. Sufficient conditions for the last condition of Assumption^ can be obtained by an 
extension of Proposition 2.10 in JTi I and Lemma 2 .7 in \2!fj , which present conditions for com¬ 
pleteness and non-Zenoness of trajectories, respectively, towards hybrid systems where the flow 
dynamics is allowed to be time-dependent, as considered in this paper, see (laI. 

We now formulate the novel distance function proposed in this paper, where we recall that 
G°(x) denotes {x} for all x £ R n . 

Definition 1. Consider the hybrid system 0 satisfying Tsswnpt?on[7] and let k > 0 denote the 
minimum integer for which Asswmption[£| holds. Let the distance function d : (C U D) 2 —> R> 0 be 
defined by 

with 


(3) 


A := 


»{( 


£(CUD) 2 3ki,k 2 £ {0,1,..., k}, 
G kl (z m ) D G k2 (z v ) ^ 0 j. 


(4) 
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Hence, d vanishes on the set A, which represents all pairs of states x,y £ CUD that either are 
equal or that can jump onto each other by (at most k) subsequent jumps characterised by (jTb]) . 
The following theorem summarises particular properties of the distance function d in Definition |T| 

Theorem 1. Consider the hybrid system (jTJ) satisfying Assumption^ 7] and let k denote the min¬ 
imum integer for which Assumption holds. The function d in Definition [7] is continuous and 
satisfies 

1) d(x, y) = 0 if and only if there exist k\,k 2 £ {0,1 ,kj such that G kl ( x ) D G k 2 (y) ^ 0, 

2) {y £ C U D\ d{x , y) < /3} is bounded for all x £ C U D, and all ft > 0, and 

3) d(x, y) = d(y, x), for all x,y £ C U D. 

In addition, the set A in Q is closed. 

Proof. In order to prove 1), we prove that the infimum in © is always attained. First, we ob¬ 
serve from Assumption [l] that G is outer semicontinuous, which directly implies that G _1 is outer 
semicontinuous. In addition, as G is proper according to Assumption^ we observe that G _1 is 
locally bounded, cf. J2j. 

Since the composition Mi o M 2 of set-valued mappings M\ and M 2 is outer semicontinuous and 
locally bounded when Mi and M 2 are outer semicontinuous and locally bounded, we observe that 
G fca is outer semicontinuous and locally bounded for all k 2 £ {0,1,..., k}. In addition, reusing 
this argument, G~ kl G k2 is outer semicontinuous and locally bounded for all ki,k 2 £ {0,1,..., k}. 
Note that A = U kuk2e{01y j. } A klk2 , with A klk2 := {(z T y T ) T £ (GUD) 2 | y £ G~ kl G k2 {x)}, 
cf. ©■ As, for all k\,k 2 £ {0,1,..., fc}, G kl G k2 is outer semicontinuous and locally bounded, 
and (GU D) 2 is closed, we conclude that each set A klk2 is closed. Consequently, we find that the 
functions d kl k 2 (*i u) := dist( (x T , y T ) , A klk2 ), for each ki,k 2 £ {0,1,..., k}, are either continu¬ 
ous functions, or, when A klk2 = 0, identical to infinity. Since, clearly, CU D / 0 implies A 0 o is 
nonempty, we observe that doo(x,y ) is a continuous and locally bounded function in C U D. We 
may write d{x,y) = min fci i , 2 e r 01) k ^ d klk2 {x,y), proving that d is continuous. As each set A klk2 

is closed, A is closed, such that d{x,y) = 0 if and only if ( x T y T ) T £ A, proving 1). 

We now prove 2) by showing the stronger property that 

Yoo(x) - {y £ CUD\ 3 £ A, \\x - z x \\, \\y - z y \\ < f3} (5) 

is bounded for each fixed x £ C U D and bounded ft > 0. For any x, the set := {iu x \ ||tu x — 
*|| < ft} is compact. Since we have shown above that G~ kl G k2 is outer semicontinuous and 
locally bounded for all &q, k 2 £ {0,1,..., k}, we find that the set G~ kl G k2 {X is compact for all 
k\, k 2 £ {0,1,..., k}. As z y in © has to satisfy z y € G k2 G kl (Xp) for some k\, k 2 = {0,1,..., k}, 
we have shown that z y is contained in a bounded set. Hence, we observe that Y oc (x) is bounded, 
which implies 2). 

Property 3) directly follows from symmetry of © and which completes the proof. □ 

Remark 2. Note that the function d in (J3| is not a metric, as it does not satisfy the triangle 
inequality. Namely, if G is set-valued and, for some x, G{x) contains two distinct points y and z, 
then d(x,y) = 0 and d{x,z) = 0 by Definition^ 7J while d(y,z ) 0 may still hold in many cases. 


To illustrate that this distance function d(x, y) is non-peaking, in Fig. [2j the function d{x, y) is 
evaluated along the trajectories of Fig. [Tj While this function is discontinuous in continuous-time 
t when jumps occur, the function does converge to zero for t —>• oo. Hence, the depicted behaviour 
corresponds to the intuitive observation that the graphs of both trajectories converge towards each 
other. 

The proposed distance function d in Q is not contained in the class of functions proposed in 3], 
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Figure 2: Distance function d in |3]) evaluated along the trajectories shown in Fig. |T] of the hybrid 
system with data ([2]). 


Namely, the function d in ([3]) may not satisfy d(x,y) = d{x,g) if y £ D and g £ G(y), or 
d(x,y) = d(g,y) when x £ D and g £ G(x ), as was required in [3j. As another alternative to the 
distance function in |3|, a more complex distance function design is given in Appendix [Aj which 
in case of G being single-valued and invertible as a function from D —> G(D), ensures that the 
distance function remains constant during jumps. However, for such distance functions, the set 
{x,y | d(x,y) = 0} may become undesirably large, in particular when G is not invertible. To allow 
non-invertible jump maps, we focus on the function d as in ([3]). 

Remark 3. To observe that the distance function d in (|3j) provides an appropriate comparison 
between two states x and y of ([I]), we observe that a straightforward adaptation of Theorem 1 
in E implies that for all e > 0 and all states x £ C with 

dist(x , D U G(D)) > e, (6) 

d(x,y) < e implies \\x — y\\ < \f2e for ally £ CUD. In many hybrid systems, including models of 
mechanical systems with impacts, for each solution p the set of times where x = p(t,j) does not 
satisfy ([h]) becomes very small when e is reduced. Hence, if in these systems d{x , y) is sufficiently 
small, then ||a: — y|| will be small away from some “peaks”, which can only occur in small time 
intervals. 


4 Stability of hybrid trajectories 


We now evaluate the distance function d along trajectories ip x (t,j), p y {t,j) of ([!]). In order to 
enable the comparison of the states of two trajectories in terms of the distance d , inspired by the 
approaches in 28 for time-triggered jumps and in |3| for state-triggered jumps, we introduce an 
extended hybrid system with state q £ (C U D) 2 , such that a combined hybrid time domain is 
created. The first and second collection of n components of p q (t,j ), with <p q being the solution 
to the extended hybrid system, contain a representation of the trajectories ip x (t,j) and ip y (t,j) of 
([l]) on a ‘combined’ hybrid time domain. 

For this purpose, we construct an extended hybrid system with state q = ( x T y T ) £ (C U D ) 2 , 

continuous dynamics 


d = 




G C e := C 2 , 


(7a) 
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and jumps characterised by 


5 + = )=G e (q):=< 


G(x) 

y 

X 

, G(y\ 

'G{x)\ ( x 

, V r \G(y) 


if x £ D,y £ C\D 
if x £ C\D,y £ D 


for q £ D e ^ { q = \y) € (CUDY 


if x, y £ D 
x £ DV y £ D> . 


(7b) 


Given the initial conditions ip x (to,0) and ip y (to,0) at initial time (fo,0) for the individual traject¬ 
ories ip x ,ipy, respectively, we select the initial condition <p q (to, 0) = (ip x (t 0 , 0) ip y (to, 0)) T . 
Solutions of this extended system generate a combined hybrid time domain. This allows to com¬ 
pare two trajectories of the hybrid system at every hybrid time instant (t,j) £ dom ip q . Hereto, 
let 

Tx(t,j) := (in O nn )(p q (t,j ), /g\ 

Tyi^jj) " = ( G nn I n ) <Pq(t, j), 

such that at every time instant (t,j) £ dom ip q , the distance d(Cp x (t, j),<p y (t, j)) can indeed be 
evaluated. 


Remark 4. We note that when one of the two trajectories ip x (t,j) and (p y (t,j ) has a time do¬ 
main that is bounded in t-direction, then this extended system does not represent both trajectories 
completely, cf. Assumption [^| Namely, if a trajectory of 0 (say, the trajectory ip x ), has a time 
domain that is bounded in t-direction, such that t < T, for all (t,j) £ dom <p x , then s < T for 
all ( s,j ) £ dom ip q as well, with <p q (t,j) the corresponding solution to (J7|. To see this, note that 
when dom <p x is bounded in t-direction, then tp x leaves C U D, has a finite escape time, or has 
an accumulation of jumps (i.e., experiences Zeno-behaviour), cf. 0 Proposition 2.10]. By the 
construction of 0> we observe that ip q also leaves C e U D e , has a finite escape time, or has an 
accumulation of jumps. If dom y> y contains a hybrid time (t,j) with t > T, then the trajectory ip y 
at this time instant is not captured in the dynamics of |7|. 

If both trajectories are unbounded in t-direction, then the functions (p x ,(py in (|8j) are repara- 
met.erisations of trajectories ip x ,tp y of ([Tj) . To be precise, there exist non-decreasing functions 
3x,jy : N -)■ N such that <p x (t,j) = <p x (t,j x (j )) and (p v (t,j) = ip y (t, j y (j)), for all (t,j) £ dom ip q . 


We now employ this combined hybrid time domain and the distance function ([3| in order to 
define the stability of trajectories for hybrid systems. 

The distance function defined in ([3]) allows to compare different points x,y £ C U D while taking 
the jumping nature of the hybrid system 0 into account. We will now define the stability of 
trajectories for hybrid systems analoguous to the definition for ordinary differential equations, 
cf. 19 , by replacing the standard (often Euclidean) metric by the distance function d in pi). In 
this manner, we obtain a stability notion that allows “peaking” of the standard metric, cf. |3|. 
Given a trajectory of ([T]), we say that a trajectory (<p£ (p y ) of ([7]) represents ip x in the first 
n states when (p x is a reparameterisation of ip x as in Remark [4j Clearly, any trajectory to ([TJ) 
represents ip x in the first n states when both <p x (to,0) = </?(fo,0) holds and this initial condition 
has a unique solution to ([!]), as considered in (S3 . 


Definition 2. Consider a hybrid system (jTJ) satisfying Assumptionand let d be given in Q. 
The trajectory ip x of |l]) is called stable with respect to d if for all e > 0 there exists a 6(e) > 0 
such that for every initial condition ip y (t o ,0) satisfying d(ip x (t 0 , 0), tp y (to, 0)) < 5(e), it holds that 


d(<Px(t,j),<p y (t,j)) < e for all (t,j) £ dom ip q , 


(9) 


8 






with ip q (t,j) = t j)) ^ e ^ n 9 an y trajectory of the combined system 0 with initial condition 

( < Ae(^Oj0) T 0) T ) T that represents <p x in the first n states, and is called asymptotically 

stable with respect to d if S can be selected such that, in addition, 


lim d{ip x {t, j),<p y (t, j)) = 0. (10) 

>oo 


When the trajectory (p x is asymptotically stable with respect to d and (10) holds for all solutions cp q 
to 0 representing ip x in the first n states, then the trajectory ip x is called globally asymptotically 
stable with respect to d. 


Remark 5. This notion of the stability of a trajectory ip x corresponds to an intuitive stability 
notion if convergence of d((p x (t,j),Cp y (t,j)) to zero implies that, firstly, the Euclidean distance 
\\(p x {t,j) — <Py{t,j )|| converges to zero apart from some “peaks” near the jumps and, secondly, that 
the time mismatch of the jumps, which coincides with the time duration of these peaks, converges 
to zero. 

Indeed, we can identify an important class of trajectories ip x for which these implications holds. 
Given a trajectory ip x , let T£ d (e) := {t > r| dist(ip x (t,j), D U G(D)) < e, for all j with (t,j ) £ 
dom ip x } for e > 0. Consider the class of trajectories tp x for which the Lebesgue measure of 
T^dfe), for sufficiently large t, tends to zero for e —> 0 (for example, this class contains periodic 
trajectories that visit D U G(D) finitely many times each period, or when the trajectory remains 
bounded away from D D G(D)). When such a trajectory is asymptotically stable with respect to 
d, we observe that for any trajectory ip y with d((p x (to,0),ip y (to,0)) sufficiently small, after some 
transient, d(fi x (t, j),(p v (t, j)) < e, with small e > 0. According to i?emarfc[5j for every e > 0 there 
exists T > 0 such that || (p x {t,j) — <p y (t,j )|| < y/2e, for all ( t,j ) £ dom <p q ,t fL T^(e). Hence, since 
the measure ofTif d (e) tends to zero for e —► 0, the duration of possible “peaking” in the Euclidean 
error tends to zero, and away from these peaks, || fi x (t,j) — (p y (t,j )|| tends to zero. 


5 Lyapunov conditions for stability of trajectories with re¬ 
spect to d 


Now, we present sufficient conditions for stability of a trajectory of the system 0 in the sense 
of Definition [2j that are based on the existence of an appropriate Lyapunov function. In order to 
allow the Lyapunov function to increase during flow, and decrease during jumps, or vice versa, 


the following definitions of minimal and maximal average inter-jump time are adapted from 28 

Definition 3. 


• A hybrid time domain E is said to have minimal average inter-jump time r > 0 if there 

exists Nq > 0 such that for all ( t,j ) £ E and all ( T , J) £ E where T + J > t + j, 

J-j<iVo + — • (11) 

T 

• A hybrid time domain E is said to have maximal average inter-jump time t > 0, if there 

exists N 0 > 0 such that for all (t,j) £ E and all (T , J) £ E where T + J > t + j, 

J-j>—-iV 0 . (12) 

T 

We say that a hybrid trajectory ip q has a minimal or maximal average inter-jump time if dom ip q 
has a minimal or maximal average inter-jump time, respectively. 


The following theorem presents Lyapunov-based sufficient conditions for the stability of a 
trajectory of Q. When the trajectories of 0 have a minimal or maximal average inter-jump 
time, the requirements on the data of 0 is less restrictive than in the generic case. As we are 
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interested in the stability of a trajectory, these conditions are imposed only near this trajectory. 
For this purpose, we recall that given a function function V : R 2rl —» R> 0 and scalar vl > 0, 
R _1 ([0, vl\) denotes {q £ R 2 "| V(q) £ [0,ul]} 

Theorem 2. Consider a hybrid system ([Tj) satisfying Assumptions [7] and[l| Let d be given in 
([3]). The trajectory ip x of system ([l]) is asymptotically stable with respect to d if there exist a 
continuous function V : R n x K" —» R> 0; -functions aq, a 2 , a scalar Vl > 0 and scalars A c , A d 
such that V is continuously differentiable on an open domain containing Vl '■= H _1 ([0, vl\) and, 
for all ( t,j ) £ dom ip x , it holds that 


for all y such that 


£ CA U D e 


ai{d(tp x (t,j),y)) < V(ip x (t,j),y) < a 2 (d(tp x (t,j),y)), 

Vrr (i,jT 

y 

V(g) < e Xd V(q), for all g £ G e {q), 


and all y such that q = 


y 


£ D e nv L , 


f) < A c V(ip x (t,j),y) for all f £ F e (t,q) 


dV 
dq 

and all y such that q = 


y 


£ C e D Vl, 


(13) 


(14) 


(15) 


and at least one of the following conditions are satisfied: 

1) A c < 0,A d < 0; 

2) all trajectories of 0 have minimal average inter-jump time 2r > 0,A C < 0 and Ad + A c r < 0; 

3) all trajectories of 0 have maximal average inter-jump time 2r > 0, Ad < 0 and Ad+A c r < 0. 


When ( |14[ ) and (15) hold for all y such that q = (y> x (t,j)^ 
ip x is globally asymptotically stable with respect to d. 


y T ) T £ D e and C e , respectively, then 


Proof. We restrict our attention to trajectories ip q to ([7| that represent ip x in the first n states. 
These trajectories always exist, which follows from the comparison of (11 and ([TJ) and the obser¬ 
vation that ip x is a trajectory to 0. The observation that tp y given in |8j) is a reparameterisation 
of a trajectory ip y for ([l]), and both p x and ip y are unbounded in f-direction by Assumption [2j 
proves that the trajectory <p q is unbounded in f-direction. 

We first prove that V(ip q (t,j)) < vl for all (t,j) £ doming and all trajectories y> q of ([?]) if 
kV(ip q (t 0 , 0)) < Vl, where k is chosen as k = 1 if 1) holds, k = e XdN ° if 2) holds and A d > 0, and 
k = e XcN ° T if 3) holds and A c > 0, with A^ 0 given in Definition [0 Observe that if all trajectories 
of 0 have a minimal or maximal average inter-jump time 2r, then 0 has minimal or maximal 
average interjump time r. 

To prove that the values of k defined above are appropriate, for the sake of contradiction, sup¬ 
pose that kV(ip q (to, 0)) < vl and there exists a time (t 0 +T,J) £ dom ip q , T,J> 0, such that 
V(ip q (to + T, J)) > vl■ Hence, there exist T <T and J < J such that (to +T,J) £ dom tp q , and 


V{y q (t 0 + T,J)) > v L , 


(16) 


but V(<p q (t,j)) < v L for all (t,j) £ R := {( t,j ) £ dom ip q \ t < t 0 + T V j < J}. 

Given the inequalities (13 )-( |15| ) and the fact that ip q represents ip x in the first n states, we observe 
that we may replace p x with c p x and (t,j) £ dom ip x with (t,j) £ dom ip q in these inequalities, 
as <p x (t,j) = <p x (t,j x (j)), for all (t,j) £ dom <p q , cf. Remark|4j Hence, V{g) < e Xd V{y> q {t, j)) and 

(% ,/) < KV(ip q (t,j)) hold for all (t,j) £ R, f £ F e {t,ip q {t,j)) and g £ G e (ip q {t,j)). 

Analogue to 28, we study the function t,j >->■ w(t,j ) := V{(p x {t,j),(p y {t,j)) along the given 
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solution ip q over the time domain R and we introduce scalars {tj} such that R = \JA\tj, tj+\\ x {j}). 
As, for each j, (p x ,tp y are absolutely continuous in t in the time interval [tj,tj+i] x {J}, w{t,j) is 

absolutely continuous in t as well. Evaluating w(t,j ) = ^ fDAfflAj = A^f for some 

/ £ F e (t, (<p x {t,j) l Py{tij)) T )i we find w ith |l5| ) that w{t,j ) < A c w(t,j). With the comparison 
lemma, [15, Lemma 3.4], we find w(tj + i, j) = e Xc ( tj+1 ~ t Aw(tj,j) for all j. For a subsequent jump, 
(14) yields w(tj+i,j + 1) = e Xd w(tj + i, j). Applying this result repetitively, we find 


Ato + T,j) = V(<p 9 (to + T, J)) < e XcT+XdJ V(ip q (to, 0)). 


(17) 


If case 1) of the theorem holds, we directly observe V(ip q (to + T, J )) < V(<p q (to, 0)), contradicting 


(16). If Ad > 0 and case 2) holds, then the definition of minimal average inter-jump time yields 
A C T + XdJ < 7 (A c t + A d) + XdN 0 < \dN 0 , such that with |T7| ) we find V(ip q (to + T,J)) < 
kV(<p q (to,0)) < Vl, contradicting If A c > 0 and case 3) holds, then applying the definition 
of maximal average inter-jump time, we observe that A C T + XdJ < (Ad + A c t)J + tN 0 X c < X c tN 0 . 
Substituting this inequality in (fl7|) we find V(ip q (to + T, J )) < kV(ip q (t o ,0)) < vl, contradicting 


(16). A contradiction has been obtained in all three cases, proving that kV(ip q (to, 0)) < vl implies 
<p q (t,j) £ Vl for all (t,j) £ dom ip q . Hence, V(<p q (to, 0)) < ~ implies that, for all (t,j) £ dom <p q , 
V(<p q {to+t,j)) < e x “ t+Xdj V(ip q (t o ,0)). 

Assumption[2]states that all trajectories of |l]) are unbounded in f-direction, which implies G(D) C 
CUD. Hence, we find tp q (t 0 + t,j) £ C e U D e and we can use |l3| . Consequently, we find 
d(ip q (to+t, j)) < a^ 1 {e Xct+x Va 2 {d{^p q {to 1 Q))))■ With the inequalities for A c f + Adj derived above, 
we conclude that in any of the three cases of the theorem, d(ip q (to+t, j)) < ct^ 1 (ka 2 (d(tp q (to, 0)))), 
proving stability with respect to d. Again using the mentioned inequalities, we observe that 
X c t + A dj —> —oo along the solutions (this limit can be used since all trajectories are unbounded 
in f-direction, cf. Assumption [2]), such that d((p q (t 0 + t,j )) —► 0. This proves asymptotic stability. 
When (14) and jl5| ) hold for all y such that 

T ^ £ C e U D e , then the upper bounds on d(ip q (to + t,j )) prove global asymptotic 

□ 


( 9x(t,j) T 

stability. 


y 


We note that the conditions as presented in this lemma can be extended to time-varying 
Lyapunov functions V. Furthermore, as all trajectories of 0 are complete by Assumption [2j it 
directly follows that G{D e ) C D e UC e , such that (13) implies that V is defined on CeU-DeUG^e). 


Remark 6. The Lyapunov function V in this theorem is closely related to the Lyapunov functions 
used for incremental stability, see e.g. L r l\\27l for ordinary differential equations and f2dj for hybrid 
systems where incremental stability is defined with respect to the Euclidean distance , and Lyapunov 
functions in f33j/ where incremental stability with respect to non-Euclidean distance functions is 
investigated for ordinary differential equations. In fact, if the conditions of Theorem hold for 
any solution t p x (t,j ) of (JTJ) , then they imply an incremental stability property with respect to the 
distance d. Sufficient conditions for this more restrictive system property are attained by replacing 
ip x (t,j) in (13)-(15) with x and requiring the conditions to hold for all ( x T j/ T ) £ C e U D e . 


For the specific class of hybrid systems with a jump map that is an affine function of the 
state, and a jump set that is a subset of a hyperplane, in the following section, a piecewise 


quadratic Lyapunov function is presented which, locally, satisfies the requirements (131 and (141 


by design. Hereby, we provide a constructive Lyapunov-based approach for (local) stability analysis 
of trajectories for this class of hybrid systems. 


6 Constructive Lyapunov function design for hybrid sys¬ 
tems with affine jump map 

We now focus on the class of hybrid systems that have single-valued, affine and invertible jump 
maps and have jump sets characterised by a hyperplane. In addition, the boundary of the flow set 
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Figure 3: Pictorial illustration of the phase space of (18) for the case n = 2. 


C contains the jump set D and its image G(D), and the jump set D is contained in a hyperplane, 
or a halfspace of a hyperplane. These assumptions are satisfied for a relevant class of hybrid 
systems, such as models of mechanical systems with impacts, see, for instance, the examples in 
Section |H 

To be precise, we focus on the class of hybrid systems given by: 

x = f(t,x), x £ C, (18a) 

x + = Lx + H, x £ D (18b) 

with the function / measurable in its first argument and Lipschitz in its second argument, the 
matrix L £ R raxn being invertible, and H £ R n . Furthermore, the sets C and D are nonempty, 
closed and satisfy 


C C{x£ R”| Jx + K < OA 

(JL~ 1 x + Jv — JL~ 1 H)s < 0}, (18c) 

D := {x £ C\ Jx + K = 0 A Z\x + 02 < 0}, (18d) 


where the parameters J T ,zf £ R n \ {0}, K , z% £ R characterise the half hyperplane containing 
D, and s £ {—1,1} is selected such that n g d := s(L~ 1 ) T J T is a normal vector to G(D) pointing 
out of C, cf. Fig. [3j as we note that G(D) C {x £ R ra | JL~ x x + K — JL~ X H = 0} follows from 
the definitions of D and G. Let G(D) C C and the following assumption hold. 


Assumption 3. 


The data of (18) is such that there exist scalars 03,24,2:5 > 0 such that 


• Z\x + 02 > Z3 for all x £ G(D), 


• Jx + K < —04 for all x £ C that satisfy \z±x + 02 1 < ~3; 


for all x £ C with z±x + 02 < 0, there exists ay £ D such that Jx + K < — 05 11 a? — y\\, 


all maximal solutions of ( 18 ) are complete. 


The first three bullets of this assumption are illustrated in Fig. |4j Note that this assumption 
directly implies D D G(D) = 0, such that the first part of Assumption [ 2 ] holds with k = 1. In 
fact, D and G(D) are positioned at opposite sides of the hyperplane {x £ R”| 01 x + 02 = 0}. We 


observe that all solutions to (18) have a time domain that is unbounded in f-direction, as, firstly, 
G(D) D D = 0 excludes Zeno-behaviour since D is closed, secondly, G is linear and, thirdly, / is 
Lipschitz in its second argument. Hence, the hybrid system (18) satisfies Assumptions [l] and [2j In 
Section [8j we present examples of mechanical systems with impacts of the form |l8| ) that satisfy 
Assumption [3] 

In order to present a constructive Lyapunov function design, we first introduce the function G : 


—y. 


as 


G{x) := Lx+H+M(Jx+K)+sLJ T max(0,0iX+0 2 ), 


(19) 


where the parameter M £ R” is to be designed. Note that if x £ D, then G(x) = G(x) = Lx + H. 
Since G(D) D D = 0, Definition [l] implies that d(x, y) = 0 if and only if x = y. or x = G{y) or 
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Figure 4: Pictorial illustration of the phase space of (18) when Assumption [3] is satisfied. The 
second and third bullet of this assumption imply that the intersection between C and the domains 
depicted in dark gray and light gray, respectively, is empty. 


y = G(x). To design a Lyapunov function V, we note that (13) requires that V(x,y) = 0 if and 


only if d(x,y) = 0. Hence, we propose the following piecewise quadratic Lyapunov function 


V(x,y) = min(||x - y\\% , ||rc - G(y) ||i , ||G(x) - y\\% ), 


( 20 ) 


where the positive definite matrices Po,P s G K nx " are to be designed. While this function is not 
smooth, we restrict our attention to a sufficiently small sub-level set where, as we will show in 
Lemma 4, the function is smooth. 


Design of Lyapunov function parameters 


To design the parameters Pq , P s and M of the Lyapunov function V in (20), we distinguish the 
domains 


S 0 := {{x,y) £ (CUD) 2 \ V{x,y) = \\x-y\\ 2 Po }, (21a) 

S 1 :={(x,y)£(CUD) 2 \ V(x, y) = \\x - G(y)\\ 2 Pe }, (21b) 

S 2 :={(x,y)£(CUD) 2 \ V(x,y) = \\G(x) - y\\%J. (21c) 


The following lemma characterises the possibility of jumps from these sets, as illustrated in Fig. [5] 

Lemma 3. Consider the hybrid system fl8| andV in (20). Let M £ K" satisfy (JL~ 1 M+l)s < 0, 
let Po,P s S 0 and let Assumption [3| hold. There exists a > 0 such that for the sub-level set 
Vl '■= H _1 ([0,Ui]) the following statements hold: 


1) Vl consists of the union of the mutually disconnected sets So D Vl, Si D Vl and S 2 D Vl- 


2) Si n V L n (D x (C U D)) = 0 and S 2 nV L n (C U D) x D) = 0. 

3) it holds thatz\y + z 2 < 0 for all ( x T y T ) T £ S\C\Vl andz\x + z 2 < 0 for all ( x T y T ) T £ 

s 2 nv L . 


Proof. The proof is given in Appendix |B| 


□ 


We note that 3) implies that max(0, Z\X + z 2 ) = 0 in (19) if V(x,y) = ||x — G(j/)||p < vl 
or V(x,y) = ||G(x) — j/||p < vl- In addition, this lemma allows to limit the number of jump 
scenarios between the sets So, Si, S 2 . Jumps of (18) may trigger jumps between these cases. From 
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Figure 5: The three nodes indicate when x and y may jump provided V(x,y) < vl , with vl as 
in Lemma [3j When the conditions of Lemma [ 4 ] hold and, in addition, V(x,y) < max(l, e~ xd )vL 
right before a jump, then this jump satisfies the scenarios depicted by arrows. 


item 2) in Lemma |3j we observe that for (x,y) £ Si fl Vl (or (x,y) £ S 2 D Vl) jumps of x (or y, 
respectively) are not feasible. In addition, when x jumps and (x,y) £ So , then, after the jump, 
G{x) £ G{D) implies Z\G{x) + z 2 > Z3. When, in addition, ||x — y\\% 0 was sufficiently small, 
then we find ||G(x) — G(y) |||> < Vl (this statement has been made rigourous in the proof of the 
following lemma), and we obtain ( G(x),y ) £ Si after the jump. Consequently, the feasible jump 
scenarios are depicted in Fig. |5| Hence, (14) has to be proven along the four jumps depicted in 
Fig- i For this reason, Lemma [3] is instrumental to prove the following lemma, that imposes the 
first design conditions on the parameters P 0 , P s and M of the Lyapunov function V in (20). 


Lemma 4. Consider the hybrid system (18), let M gR" satisfy (JL 1 M + l)s < 0, letP 0 ,P s >- 0 
and let Assumption^hold. Consider the function V in ( 20). If for some Ad £ R it holds that 


(L + MJ) t P s {L + MJ) < e Xd P 0 , 
Pq S e Xd P s , 


( 22 ) 

(23) 


then there exist K-oo-functions £* 1 , 0:2 and Vl > 0 such that the conditions (13) and (14) in The¬ 
orem ; [ 2 ] are satisfied with Vl = 1 ([0, Vl]) and the function V in (20) is smooth on an open 
domain containg Vl- 


Proof. The proof is given in Appendix [B] □ 

This lemma provides sufficient conditions on the dynamics of the hybrid systems such that 
the conditions on the Lyapunov function and its evolution along jumps of ([Tj) are satisfied. Addi¬ 
tionally, (15) in Theorem [ 2 ] imposes conditions on the evolution of the Lyapunov function along 
flows of (JlJ). In the following section, we present a design for V such that these conditions are also 
satisfied for an important class of hybrid systems. 


7 Tracking control problems 

In this section, we will employ the results on the asymptotic stability of jumping hybrid trajectories 
to solve a tracking problem of a hybrid trajectory with jumps. 


We restrict our attention to tracking control problems for the class of systems (18) with f(t,x) = 
Ax + E + Bu{t, x), A £ R nx ", E,B £ R n , with a control law u : [0, 00 ) x C —> M to be designed. 
In the scope of this tracking problem, we consider a reference trajectory Xd , which is a solution 


to (18) for a feedforward input signal u(x,t) = ug(t). We assume that y is a trajectory that is 
generated by the control signal u(t, y) = ug(t ) + Ufb(t, y), and assume that tifb vanishes along the 
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trajectory x d , i.e. un,(t, x d (t)) = 0 for almost all t. Hence, the flow map of the extended hybrid 
system 0 is given by 


f Axd+E+B(us(t)+Ufb(t, Zd))\ 
y Ay+P+P(it ff (f)+Ufb(t,y)) )' 


(24) 


Introducing the function x d (t) :=x d (t, min j) design a switching feedback law Ufb as: 

(t j)edom x d 


T 

T ' G So 


Ufb(t,y) = < 


'-co{xd(t) ~ y ), 

for (xj(t) y 

WfePi(*) ~ c i (xd(t) - G(y)), 

for (x%(t) y T ^j € Sx 
jrjlfoit) ~ C2{G(x d {t)) -y) 
for (a£(i) y 


(25) 


. T 

T ' gS 2 


with 


o > m 


Ax d {t) + Bue(t) + E 
AG°(x d (t)) + Buff(t) + 


£ 


Pi(t) = (l n —L — MJ) 

a (f] _ (r , M J n ( Md( ^> + ^ ^ 

+ M ^ Jn) Ug(^W) + Bu s (t) +Ej- 

P 2 = ~(L + MJ)B and /3± = —B, where G°(x) is designed as G°(x) = (L + MJ)~ 1 (x — H — MK ), 
which coincides with the inverse of G restricted to Si D Vl ■ 

Using this switched control law, which switches on the basis of the Lyapunov function designed 


in (20), we formulate in the following result explicit conditions on the controller parameters 


Co, Ci, c 2 , M, Pq and P s under which the tracking problem is solved. 


Theorem 5. Consider the hybrid system (18) with f(t, x) = Ax+E+B(uff(t)+Ufb(t,x)), for some 
measurable function Uff[t) and letx d be a solution of (18) for up = 0. Let Pq,P s G R nxri , M G R", 
considerV as in (20) and letup, be designed as in (25), with x d {t) = x d (t, min^ p ec i orn Xd j) and 


Cq ,c[ ,c% G R". Let L + MJ be invertible and B 0. 


Let the assumptions of Lemma^ hold for X d G R, let all trajectories of (181 have a time domain 
that is unbounded in t-direction, and assume 


hold for almost all t. 
Let, for some X c G R, 


0i(t) G span(/3 2 ), and fiz{t) G span(/34) 

the following LMIs be satisfied: 

(A + Bcq) t Pq + Pq{A + Bcq) — X c Pq A 0, 
P s (/3 2 C 1 + ( L + MJ)A{L + MJ) ■*■) + (/32Ci + 
(L + MJ)A(L + MJ)~ 1 ) t P s + A C P S A 0, 
Ps(A + Pc 2 ) + (A + Bc2) t P s + A C P S A 0. 


(26) 


(27) 

(28) 
(29) 


If either of the following cases hold, then the trajectory x d is asymptotically stable with respect to 

d. 


1) A c < 0, Ad < 0, 

2) all trajectories of (JTJ) have minimal average inter-jump time 2r > 0, A c < 0 and X d +X c r < 0, 

3) all trajectories of 0 have maximal average inter-jump time 2r > 0, A^ < 0 and X d +X c r < 0. 

Proof. The proof is given in Appendix [B] □ 
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8 Examples 

We now present two examples to illustrate the results of this paper. In the first example, a tracking 
control problem is studied for a bouncing ball system where forces can be applied to the system. 
The tracking controller and Lyapunov function will be designed such that A^ = 0 and A c < 0, such 
that case 1) of Theorem [5] is used to prove asymptotic stability of the reference trajectory. 

In the second example, a hybrid system is considered and a control law is proposed for which a 
maximal dwell-time argument proves asymptotic stability of the reference trajectory, illustrating 
case 3) of Theorem [5j 

Bouncing ball system with non-dissipative impacts 

We consider a tracking problem for a bouncing ball system with position xi, unit mass, gravity 
g = 9.81 and with impacts without energy dissipation, see Figure [6] 

777777777777777 
Figure 6: Bouncing ball system. 


A finite control force u can be applied to the ball along the vertical direction of motion and the 
constraint is positioned at Xi = 0. The continuous-time dynamics can be described with 


x\ = — g + u + A, 


(30) 


with A a finite constraint force satisfying the linear complementarity relation A > 0, xi > 0, Axi = 
0. When this system arrives at Xi = 0, then we apply Newton’s impact law 


xf = —Xi- 


(31) 


Provided that the finite constraint force A of this system can be ignored, (i.e., when for all time, 


either the position X\ or the velocity X\ are non-zero) this system can be modelled as (181 with 
x = (xi Xi) T , 

0 1'" '°' " ' ° ' L = —J 2 , J = (1 0), H = 0, K = 0, s = -1, zt = 


A = 


B = 


E = 


0 ^ 

0 0 J’ ~ ~ \lj- \-g , 

(0 l) and Z 2 = 0 and the set C is selected to exclude a neighbourhood of the origin, such that 
D D G(D) = 0. While excluding a neighbourhood of the origin may imply that C, D allow non- 
complete trajectories, in the following Lyapunov analysis, we prove invariance of a sub-level set 
Vl = V~ 1 ([0,vl}), for some vl, of the Lyapunov function V that characterises a neighbourhood 
of the reference trajectory and that does not contain points in dC e where solutions to ([7| cannot 
be extended. Hence, Assumptions [l]j3] hold in the flow set C e n Vl and jump set D f . fi Vl- 
We consider a tracking problem where the reference trajectory x d is a solution to ( Jl8| > for the 
feedforward function ug(t) = 0 with initial condition x<j(0,0) = (0 10) T . Now, the tracking 

control law (25) is applied and Theorem [5] is used to find parameters cq,ci,C 2 ,Pq,Ps, and M. 
We may select A d = 0, M = (0 0) , Co = ci = — (k c), with k = l,c = 0.5, and Pq = P s = 
2 25 0 5\ 

0 g 2 J, that is the solution to (A+ Bcq) t Pq+Pq(A+Bcq) = —I. We select A c = —0.25, such 

that (27) is satisfied, which, with L + MJ = —I 2 , directly implies (281. Consequently, Theorem [ 5 ] 
proves that the trajectory Xd is (locally) asymptotically stabilised with respect to d by the control 
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Figure 7: a) Control action u applied to the trajectory x for the bouncing ball system with non- 
dissipative impacts, b) Lyapunov function V in (20) evaluated along the trajectories shown in 

Fig-0 


law ( p5| ). 

In Fig. -b), the reference trajectory Xd and plant trajectory x of the system is shown. In 
addition, the Euclidean error is depicted in panel c). Observe that x accurately tracks the reference 
trajectory Xd in the sense that jump times converge and, away from the impact times, the Euclidean 
error remains small and tends to zero. In Fig. [TJ the applied control input u and the Lyapunov 
function V are shown. In Fig. [2} the distance function d(x, Xd) in ([3| is depicted when evaluated 
along these trajectories. 

Observe that this distance converges asymptotically to zero. Hence, the controller design in 
Section [7] solves the tracking problem and renders the trajectory Xd asymptotically stable. 


Remark 7. In the same control law was designed in an ad-hoc manner for this specific case. 
Interestingly, the same control law up, in (25) now follows in a systematic manner from the generic 
design framework presented in this paper. Clearly, this generic framework is applicable to a much 
wider range of examples, indicating the relevance of the presented work. 


Dissipative mechanical system with impacts 

Now, we consider a single degree-of-freedom system with a damper with damping constant c > 0 
and a spring with stiffness k > 0 and unloaded position x = x\, as shown in Fig. [8] Impacts can 
only occur at the constraint at X\ = 0. Let the impacts be described by a restitution coefficient 



Figure 8: Dissipative mechanical system. 


e = 0.9. Hence, the impacts are dissipative, which allows to 
using a maximal average inter-jump time result. Assuming 
ignored, the hybrid system is described by (181 with 


study the stability of the trajectory 
that finite constraint forces can be 


A = (-* -<=)' B = (!)• E = U°J. L = J = h 0). K = 0, H = 0, . = -1, 

Zi = (0 1) , Z 2 = 0 and the set C is selected to exclude the origin. The parameters x\ = 1, k = 1 
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Figure 9: Reference trajectory Xd for the dissipative mechanical system and trajectory x with 
nearby initial condition for u = ug(t). 


and c = 0.02 are used. 

Let the reference trajectory Xd be a solution to (181 for a feedforward function u = ug(t) = 
100cos(o;t), with u> = 0.4, as shown in Fig. [9| This forcing is selected such that the reference 
trajectory Xd with initial condition x<i(0, 0) = (50 0) has a maximal average inter-jump time 

Td > 0. In addition, Xd(t,j) does not arrive at the origin. To show that the tracking problem is 
not trivial, in the same figure, a trajectory of is depicted with the same forcing and initial 
condition x<i(0, 0) = (51 0) T . Clearly, both trajectories diverge. 

For this example, we derive an explicit expression for the distance function. As the reference 
trajectory Xd stays away from the origin, we can model the system with D = {0} x (—oo, —r], 
with r > 0 sufficiently small, such that G(D) = {0} x [er, oo). Then, © yields 

d(x, y) = min(d 0 (x, y), d x (x, y), d 2 (x, y)), (32) 


with d 0 (x,y) = inf Zx=z eC 


y-z v 


, di{x,y) = inf Zx=G(2H)iZy 


£D 


y-Zy 


and d 2 (x, y) = 


di(y,x). We will now find explicit expressions for d 0 and di- By the observation that d%(x,y) = 
inf 2a . e c' ||^ — 11 2 +113/ — z x \\ 1 1 we observe that the infimum is attained z x = which is contained 

in C when, firstly, do(x,y) is sufficiently small and secondly, x = Xd with the reference trajectory 
sufficiently far from the origin. Hence, we obtain 


do(x,y) = -^=\\x-y\\. 


Now, we compute di(x,y) using that 
di{x,y) 2 = 


inf 

Zx — G (Zy ),2yC D 
2.2 


X - Z x 
y-Zy 


(33) 


(34) 


— inf x 1 + y 1 + (x ’2 + sz y 2 ) + (y 2 — z y2 ) 


<- 


Z V 2 ^ 
)2 


Studying ^(xj +yf + (x 2 + ez y2 ) 2 + (y 2 - z y2 ) 2 ) = 2 e{x 2 +ez v2 ) - 2 (y 2 - z y2 ) = 0, leads to the 

minimiser z y2 = when < — r, and z y2 = —r otherwise. Substituting this expression 

in (34), we obtain, after some algebraic manipulations, that 


di(x,y) = < 


rp2 I „2 I (sy 2 +x 2 ) 2 
X 1 -I- 1+e 2 , 

if V 2 ~ex 2 < 

1+e 2 ’ 

\J Xi+yf + {x 2 —£r) 2 + (y 2 +r) 2 , 

otherwise, 


(35) 
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where, in the first case, we used the relations x 2 + ez y 2 = and 3/2 — -^2 = • We 

||y|| implies that the second case in (351 will not be attained when 


note that for e > 0, r -C ||x||, 
d(x,y) = di(x,y). Recall that d\{x,y) = d 2 {y,x), such that (32) gives 

d{x, y) = min(do(^, y), di(x, y), d^y, x)), 


(36) 


with do in (33) and d\ in (35). 


We now apply the constructive control law design proposed in Section PF] to enforce tracking of the 
trajectory Xd- Selecting P 0 = f ^ j and P 3 = \Po, we observe that the conditions of Lemma 4 
are satisfied with Xd = log(e) < 0. In addition, we observe that cq = C\ = C 2 = 0 can be selected^ 
such that ( 27 )-( 29 ) hold with A c = 0, as PqA + A t P 0 = ^ and P S A + A T P S = ^ 

Then, (25) yields the control law: 


Ufb(t-,x) = < 


°> ( x d ( i ) v T ) e S o 

-±±£(kx 1 +u s (t)), 

( x d(t) y T ) e 5i 
-(1 + e)(kx 1 +u s {t )), 

(*!(*) 


(37) 


. T 

G S 2 


As the trajectory Xd has a maximal average inter-jump time, denoted t,i- nearby trajectories will 
have the same behaviour. Hence, selecting vl > 0 sufficiently small and restricting our attention 
to the hybrid system 0 with flow set C e D Vl and jump set D e D Vl, with Vl = V 1 ([0,ul]), 
we conclude that x also has a maximal average dwell-time t x , with t x close to r f ;. Hence, the 
trajectory of the embedded system ,0 has a maximal average inter-jump time max ^ d,Tx ) > 0. 
Consequently, case 3) of Theorem [ 5 ] proves that the trajectory is (locally) asymptotically stabil¬ 
ised with respect to d by the control law 


In Fig. |10[ the performance of this controller is illustrated and a trajectory with initial condition 
x(0, 0) = (lOO 0) T is shown to Xd- 


From the structure of the control law (37), we observe that no control is active when V j), Xd{t,j)) 
|| ip y (t,j) — Xd{t,j)\\p 0 . In fact, the dissipative effect of both the damping force cx and the jump 
map implies that no control is needed during these time intervals. The control input u only needs 
to compensate the potentially destabilising effect of the forcing term (E + Bug) during the “peaks” 
of the Euclidean error. 


9 Conclusion 

In this paper, we considered the stability of time-varying and jumping trajectories of hybrid sys¬ 
tems with state-triggered jumps, which is essential in tracking control, observer design and syn¬ 
chronisation problems. A general distance function design was proposed that allows to compare 
two trajectories of a hybrid system, thereby enabling the stability analysis for hybrid trajectories. 
This stability analysis was employed and allowed to propose a constructive tracking control law 
for a class of hybrid systems. 

The proposed design for the distance function takes the nature of the jumps of the hybrid system 
into account, such that the distance function provides a good comparison between the traject¬ 
ories of two solutions, without the “peaking behaviour” along solutions that is expected in the 
Euclidean distance. The stability properties of trajectories were studied in terms of this distance 
function. Sufficient conditions for stability have been formulated using Lyapunov functions with 
sub-level sets that consist of disconnected pieces. Moreover, the conditions are formulated in terms 
of maximum or minimum average inter-jump time conditions to allow for increase of the Lyapunov 
function over flow or jumps, respectively. In case the jump map is an affine function and the jump 
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Figure 10: a) and b) Reference trajectory Xd and plant trajectory x for the dissipative mechanical 
system and periodic forcing, c) Euclidean tracking error, d) Distance function ([3]). e) Control 
force u. 
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set a hyperplane, a piecewise quadratic Lyapunov function was proposed that can be constructed 
systematically. 

Focussing on a class of tracking problems for hybrid systems where control is only possible during 
flow, we designed a switching tracking control law. The asymptotic stability of a reference traject¬ 
ory of the closed-loop system can be assessed with matrix conditions obtained from our general 
theory. 

Finally, we applied the proposed tracking control law in two examples and observed that the con¬ 
trol law achieves accurate tracking. These examples also illustrated that the presented asymptotic 
stability notion does correspond to desired tracking behaviour. This underlines that the proposed 
distance function enables a good comparison between hybrid trajectories and has the potential 
to play an important role in tracking control, observer design and synchronisation problems for 
hybrid systems. 
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A Alternative distance function 

The distance function ([3]) is not necessarily continuous over jumps, when evaluated along solutions 

to ([I]). When G is a single-valued and invertible function, such a continuity property could be 

induced by the alternative distance function design: 


dn(x, y) = inf 

N& (x iT ,y iT 


inf 

\ T 

) eA, i= i,.. 


N 

Di»‘ 

;N, i =0 


— X 


i +11 


(38) 


that coincides with the quotient metric, cf. 16 , on the quotient space generated by the equivalence 
x ~ y if (x, y ) G A. This quotient space has been suggested in |22j to study hybrid systems. We 
note that when G is non-invertible, then dg(x,y) = 0 <t=> ( x T y T ) G A may not hold. To allow 
for non-invertible jump maps, we prefer the distance function d in ([3]) over g?q in (381. 


B Proofs 


To prove Lemma [3] we need the following result. 


Lemma 6. Consider the hybrid system ( |T8| ) and G in (19), let M G K™ satisfy ( JL~ 1 M + l)s < 0, 
let Po, P s >- 0 and let Assumptionhold. There exists a di > 0 such that if ||ar — G(y)|| < <5i and 
x, y G C U D, then z±y + Z 2 < — Z 3 and z\G{y) + Z 2 > 


Proof. To prove the lemma, we first present a condition on <5i, such that ||x — G(j/)|| > di holds 
for all x, y G C U D with zpy + z 2 > —Z3, thereby proving the first implication in the lemma. 

We introduce the intermediate variables z = y + p = max(0, z\y + Z 2 ) > 0, the vector 

n g d = s(L~ 1 ) T J T , scalar k g d = sK — sJL~ l H and affine function 


c g d(x) =n^ d x + k gd = s{JL 1 x + K-JL 1 H), 

such that for all x G C, c g d{x) < 0, cf. ( |18c[ ). To provide a lower bound on ||x — G(y)|[, we will 
first derive a lower bound on c g d{G(y)). Observe that 


c gd {G(y)) =s(JL~ 1 G(y) + K- JL~ X H) 

=s^JL l (^(L + MJ)(^ jj T + 

+ MI< + sLJ T p^j + Kj 

=s(l + JL~ 1 M)Jz + s 2 JJ T p (39) 
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with fi = max(0, z\y + Z2) > 0. We directly observe c g d(G(y)) > 0 as s(l + JL~ X M) < 0 holds by 
the assumption in the lemma, and Jz = Jy + K < 0 for y £ C. 

We will now provide a positive lower bound on c g d{G(y)) for y £ C with z±y + z2 > ~z 3 . By 
Assumption [3j 

Jz = Jy + K < —Z4 for y £ C satisfying \zry + Z 2 I < z 3 , (40) 


holds, with Z4 > 0 given in the assumption. From (39) and (40), we conclude that c g d{G(y)) > 
— s(l + JL~ 1 M)z4 > 0 if \z\y + z^\ < z 3 and y £ C. When z\y + Z2 > z 3, we obtain y > z 3 and 
c g d(G{y )) > JJ t z 3 > 0. Hence, we have shown 


c gd {G(y)) > min(—s(l + JL 1 M)z4,JJ T z 3 ), 

for y £ C with z\y + z 2 > —z 3 . (41) 


For all x, y £ C it follows from the Cauchy-Schwarz inequality that 
Ik - G(y )II > pL|| n T gd {x - G(y))\, 

= W~^\\ c 9d(x) - c gd (G(y))\, 


and, as c g d{G(y)) > 0 and c g d{x) < 0, we find 

Ik - G(y)|| > rr^-nCgdiGiy)), for x,y£C, 


(42) 


and, using (41), 

Ik - G{y) || > || || min(—s(l + JL~ 1 M)z i , J J T z 3 ), 

for x,y £ C, ziy + z 2 > -z 3 . 

Hence, if x,y £ C and |k — G(y) || < <5i with 

61 < || t/-i 11 min(—s(l + JL~ 1 M)z 4 , JJ T z 3 ). 


(43) 


then Ziy + Z 2 < — z 3 holds. 

We now derive an upper bound on < 5 i satisfying ( 43 ) such that for x,y £ C with |k — G(y)|| < < 5 i, 
the relation z\G{y)+Z 2 > holds. As shown above, z±y+Z 2 < —z 3 holds, such that Assumption]^ 
implies that there exists y* £ D such that \\y — y*\\ < ■ With ( 39 ), we find Jy + K = Jz = 

s (i +JL-1M) ( as A* = °), such that 


(44) 


II,, _ ,,*|| < _ c 9 d(G(y)) _ 

11 y y 11 — -z 5 s{\+jl-^m) 
is obtained. Using (42), we observe that 

II, . _ „*|| / I n gd II lb~ — d'('jy) II , W'll gd II <^1 

II y y II - -Z 5 s{l + JL- 1 M) — -z 5 s( 1 +JL-im) 

holds for |k — G(j/)|| < 8 \. Denoting the largest singular value of (L + MJ) with £ g , we observe 
that i g > 0 since, otherwise, L + MJ = 0, such that jj? JL~ X [L + MJ)J T = s(l + JL~ 1 M) = 0, 
which contradicts the assumption in the lemma. We find 

lic(») - G(„*)ii < 

With the relation 

ziG(y) + z 2 > z 1 G(y*) + z 2 - |ki||||G(j/) - G(y*)|| 

and the observation that y* £ D implies ziG(y *) + Z 2 > z 3 by Assumption [ 3 ] we find 

Zl G(y) + z 2 > z 3 — |ki|| _ 25 S B (i + 9 j1-im) 
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such that Z\G{y) + z-i > ^ if 


£ ^ -z 5 s(1-JL 1 M)z 3 

°i zz on •>, imtsmi 7 


\\ n gd II 

whose right-hand side is positive as s(l — JX _ 1 Af) < 0. 


(45) 


Hence, for any <5i > 0 satisfying (|43|) and (45), x,y £ C and ||a; —G(y)|| < <5i implies Z\y+Z 2 < —23 


□ 


and z\G(y) + z 2 > "y, thereby proving the lemma. 

Proof of Lemma [3| In order to prove the first part of the lemma, we select a 5i < 2 |^m satisfying 
the conditions of Lemma jdj and fix vp > 0 satisfying Vp < XSf and vp < A( 2 f\z'f\ ~ <k) 2 , with 
A > 0 smaller than the eigenvalues of Po and P s . 

We now consider points x,y £ C such that ||x — G(y) ||p s < vl and prove that this implies 
|k — y\\p 0 > Vl an d ll^( a ') — y|lp s > v l- By the definition of A, we observe that ||x — G(y)\\p s < vp 
implies ||cc — G(y)\\ < 61 , such that Lemma [6] implies Ziy + Z 2 < — Z 3 and ZiG(y) + Z 2 > 

\zi(y-G(y))\ ^ 3 z 3 

Pd 


#. Hence, 


\\y-G(y)\\ > 


~ 2|Ud 


holds. We then obtain 


\\x- 


- y\\p 0 > Aik - vt > Adk - G(y )|| - ||x - G(y)||) 2 

> A(4f^ - <k) 2 > v L . 


(46) 


To prove ||G(cc) — y ||p s > vl when |k — G(y)\\p s < Vl, we suppose, for the sake of contradiction, 
that ||G(x) — y||p s < vl and ||a; — G(j/)llk < vl ■ Then, following analogous reasoning as above, 
from ||G(x) — y\\p B < Vl we conclude Z\x + Z 2 < — 23 , such that ||x — G(y)|| > ■py|y^f a > <5i- 
However, since |k — G(y) ||p < vl implies ||x — G(y)\\ < Si, a contradiction is obtained, proving 
that |k - G(y)\\p s < vl implies ||G(x) - y\\ 2 Ps > v L . 

We have proven that, for all x,y £ G, the inequality ||x — G(y)||p < vp implies the inequalities 
Ik — y\\p 0 > Vl an d ll^k) — y\\p s > Vl 7 suc h th & t So ns,n V L = 0 and S± D £>2 D Vl = 0. 
Interchanging the role of x and y in the reasoning above, we find So O S 2 D Vl = 0, which 
completes the proof of 1). 

To prove Si D Vl D (D x (G U D)) = 0, it suffices to observe that ( x T y T ) T £ Si fl Vl implies 
|k — G(y )|| < ^i and, by Lemma K3| Z\G{y) + z 2 > • Hence, Z\X + Z 2 > z\G{y) + Z 2 — 

|ki||||x — G{y )|| > ^ — |ki||(5i > 0, which directly implies x ^ D due to ( |18d l and hence indeed 
Si fl Vl n (D x CUD) =0. Since V(x,y) = V(y,x ), we also find that S 2 D Vl fl ((CUP) x D) = 0, 
such that 2) is proven. 

To prove 3), we observe that ( x T y T ) £ Si D Vl yields |k ~ G(y)||p < Vl, which implies 

\\x-G{y)\\ < Si, such that Lemma [6] implies Z\y + Z 2 < —Z3 < 0. Similarly, we obtain Z 1 X + Z 2 < 0 
for ( x T y T ) £ S 2 D Vp, proving 3). This completes the proof of the lemma. □ 

The proof of Lemma [4] relies on Lemma [3] and the following result. 


Lemma 7. Consider the hybrid system ( |18| ) and the Lyapunov function candidate V in (20) 
satisfying the conditions of Lemma |^J There exist /Coo -functions ay, ay satisfying (13). 


Proof. To find lower and upper bounds on the function V , we introduce two scalars A 7 A, with 
A > 0 smaller than the eigenvalues of Po and P s , and A > 0 larger than the eigenvalues of Pq and 
P s . Let eo (x,y) := x — y, e\{x,y) := x — G(y) and e 2 (x,y) := G(x) — y, and define the nonnegative 
functions v 0 (x,y) := ||e 0 (ir, y)||p 0 , v^x,y) := \\ei{x, y)\\ 2 Pa and v 2 (x,y) := ||e 2 (x,i 
The definition of A and A yields 


Ik- 


A| \ei(x,y)\\ 2 < Vi(x,y) < A||ei(x, 


i = 0 , 1 , 2 . 


(47) 


Observe that V{x,y) = Vj(x,y ), for some j £ /, with I = {0,1,2}. The first inequality of ( |47} 
then yields V(x, y) > A11 ©y 11 2 A A m i n ie/ || (cc, y )|| 2 holds. Note that min ie / || e^x, y )|| 2 > d{x, yf, 
cf. Q, where A = {(^J Zy ) £ C e U D e \ x = y V x = G(y) V G{x) = y} is used. Hence, we 


obtain V(x,y) > Xd{x,y)~. With oq(s) = As - 7 the first inequality in (13) is satisfied. 
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To derive an upper bound for the function V, we observe that w 


= \JV ( x , y) is a Lipschitz 


function with Lipschitz constant Ly = V~Xa, with a the maximum of the largest singular values 
of the matrices (/„ —(/„ —(L + MJ )) and (l n — (L + M J + sLJ T z\j ). Hence, 


< w 


+ Ly 


for all 


V' 


£ C e x D e . Given x,y, we can select 


is non-empty and closed, cf. Theorem 


and, hence, w 


y * 


€ arg inf ze _4 


— z 


which, since A 


exists and is bounded. We observe that V 


= 0 


= 0. Consequently, we find 

< Ly 


— arg inf 

zeA 


w 


< Ly inf 
zeA 


— 2 


= L v d(x,y), 


(48) 


where ([3]) is useed. Since V(x, y) = w 1 2 
lemma. 


, a. 2 (s) = LyS 2 satisfies (131, thereby proving the 


□ 


Proof of Lemma [^J To prove the lemma, first, we observe that Lemma [7] directly guarantees that 
there exist functions ot\,a .2 satisfying (13). In addition, Lemma [3] directly proves that there exists 
a sufficiently small Vl > 0 such that V is smooth in an open domain containing Vl- It remains to 
be proven that (p2|)-([23|) imply (14 1 . 

Recall the sets So, Si, 62 in (21). Jumps of (18) may trigger jumps between these sets. From 
item 2) in Lemma [3j we observe that for ( x , y) £ Si D Vf and (x, y) £ S 2 D Vf, jumps of x and y, 
respectively, are not feasible. Consequently, when (x,y) £ So, both x and y can jump, while from 
(x,y) £ Si, only a jump of y is feasible, and (x,y) £ S 2 implies x $ D. We will now prove that 
(14) holds along these four jumps: 

a) We first study the jump (x,y) —► (G(x),y), with (x,y) £ So- Since 3) of Lemma [3] implies 
that G(y) = (L + MJ)y + H + MK as Z\y + 22 < 0 and x £ D implies G{x) = G{x) = 
(L + MJ)x + H + MK, we observe that V(G(x),y) < ||G(x) — G(y)\\ 2 Ps = ||G(x) —G(y)||p s = 
(x — y) T {L + MJ) T P S (L + MJ)(x — y), such that ( f22j ) implies that (14) holds0 

b) For a jump (x,y) -> (x,G(y)) with (x,y) £ S^we observe Vjx,G{y)) < ||rc - G{y)\\ 2 Po = 


\x — G(y)\\p o , as y £ D. Hence, (23) implies (141 in this caseQ 


c) For a jump (x,y) —> (x,G(y)), with (x,y) £ So, (141 directly follows from combining a) with 
the symmetry relation V(x,y) = V(y,x). 


d) For a jump (x,y) —> ( G(x),y ) with (x,y) £ S 2 , symmetry of V and b) imply (14). 


Hence, we have proven that (14) holds over all feasible jumps, therewith concluding the proof of 
the lemma. □ 


1 When V ( x , y) < e~^ d vi,, we conclude that \\G(x) — G(y)\\‘j s < Vi,, which implies, by Lemma|3j that (G{x), y) S 
Si, as shown in Fig. [5] 

2 Again, when before the jump, V(x,y) < e~^ d VL holds, we conclude that \\x — G(y )|||> o < vl , such that 
(x,G(y )) G So, as shown in Fig. |5| follows. 
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Proof of Theorem [5| We prove this theorem by application of Theorem [2j Lemma [4] proves that 
(13) and (14) hold for some Vl > 0. Hence, we now show that the assumptions in the theorem 
prove that (15) is satisfied in the sub-level set Vl = V r_1 ([0, vl])- 

According to Lemma j^J V is differentiable in Vl, such that we evaluate (^ j ,/) for / £ 


dq 


F e (t,x d (t,j),y) only when q = ( x d (t,j) T y T ) € Vl D C e , where, for almost all t, F e is single¬ 

valued, and we distinguish the three cases given by the minimisers of (20). If (x d (t, j), y) £ iSoflVi, 
then 


BV 

-^ = 2(x d (t,j)-y) T P 0 (l n -I n ) 


and 


F P = 


Ax d (t,j) + E + Bug(t) 

K Ay + E+ B(ug(t) - c 0 (x d (t,j) - y)) / 

such that ( |15[ ) is guaranteed by ( |27| . 

If ( x d (t,j),y ) £ S'] D Vl , then 3) of Lemma [ 3 ] implies G(y) = (L + MJ)y + H + MK. Consequently 

% = 2 S Tp s (l n -(L + MJ )) 

and 

( Ax d (t,j) + E + Bug(t) \ 

with Si = x d (t,j) — G(y) holds. Hence, we obtain ^ F e (t , x, y) = 2sf P s (Ax d (t,j) + E + Bug(t) — 
( L + MJ)Ay-(L + MJ)E-(L + MJ)Bu m - - ( L + MJ)Bc lSl . With @, we find 

Pi (t) = (t ), such that 

P2 P 2 

%F e (t,x d (t,j),y) = 

2 s{P s (Ax d (t,j) + (I-L-MJ)(E + Bu«{t)) 

- (L + MJ)Ay - pi{t) + P2C1S1). (49) 

Since y = (L + MJ)~ 1 (—s\ + x d (t,j) — H — MK) = — (L + MJ)~ 1 s\ + G°(x d (t,j)), (which holds 
as max(0, Z\x d (t, j) + z 2 ) = 0 follows from ( x d (t,j),y ) £ Si D Vl, cf. Lemma[3]) we obtain 


%F e (t,x d (t,j),y) = 

2slP s ({L + MJ)A(L + MJ)- 1 + /? 2 ci)si, 


(50) 


where we used the design of pi. Hence, ([28]) guarantees that ([15]) holds in this case. 

Now, we focus on the case ( x d (t,j),y ) £ S 2 D Vl- In that case, from 3) of Lemma|3j we observe 
that max(0, Z\y + z 2 ) = 0 follows from (. x d (t,j),y ) £ S 2 H Vl, cf. Lemma[3j Hence, 

dV 

— =2 si P s {{L + MJ) —I n ) 


and 


Ax d (t,j)+E+Bus(t) 

\Ay+E+B (ug(t) — +c 2 s 2 ) 


F e (t, x d (t,j), y) = 

with s 2 = G(x d (t,j)) — y. From ([26]) follows %j8 3 (t) = P 3 (t), such that ^F e (t,x d (t,j),y) = 


ftf/V 

2 s%P a (As 2 -m + {l+MJ -I n ) + Bc 2 S 2 ) , where we used y = 

G{x d (t,j)) — s 2 . With the design of @3,(34, we find 

%F e (t,x d (t,j),y ) =2s 2 P s {A + /34C 2 )s 2 , ( 51 ) 

such that (29) proves that (15) holds in this case. Consequently, if (27)-(29) hold, (15) is obtained. 
Hence, Theorem [2] proves that x d is asymptotically stable with respect to d. □ 
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